ForTouch: A Wearable Digital Ventriloquized Actor
نویسندگان
چکیده
We have constructed an easy-to-use portable, wearable gesture-to-speech system based on the Glove-TalkII [1] and GRASSP [2] Digital Ventriloquized Actors (DIVAs). Our new portable system, called a ForTouch, is a specific model of a DIVA and refines the use of a formant speech synthesizer. Using ForTouch, a user can speak using hand gestures mapped to synthetic sound using a mapping function that preserves gesture trajectories. By making ForTouch portable and self-contained, speakers can communicate with others in the community and perform in new music/theatre stage productions. Figure 1 shows one performer using the ForTouch. ForTouch performers also allow us to study the relation between gestures and speech/song production.
منابع مشابه
Building a portable gesture-to-audio/visual speech system
We have constructed an easy-to-use portable, wearable gesture-to-speech system based on the Glove-TalkII and GRASSP gesture-controlled speech systems and a vizeme based face-synthesizer. Our new portable system is called a Digital Ventriloquized Actor (DIVA) and refines the use of the formant speech synthesizer. Using a DIVA, a user can speak using hand gestures mapped to both synthetic sound a...
متن کاملObjective Prediction of Visual Saliency Maps in Egocentric Videos for Content-action Interpretation
Extraction of visual saliency from video is in the focus of intensive research nowadays due to the variety and importance of application areas. In this paper we study the relation between subjective saliency maps, recorded on the basis of gazetracker data in a new upcoming video content: the egocentric video recorded with wearable cameras. On the basis of physiological research and comparing th...
متن کاملTowards an Activity-Aware Wearable Computing Platform Based on an Egocentric Interaction Model
In this paper, we present our egocentric interaction model for recognizing and supporting everyday human activities. We explain how it allows designers of ubiquitous computing systems to view physical (real) and virtual (digital) objects as residing in one single space and how sets of objects in the vicinity of a specific human actor can be classified based on human perceptual characteristics s...
متن کاملE-skin: Research into Wearable Interfaces, Cross-modal Perception and Communication for the Visually Impaired on the Mediated Stage
Today our cultural events are dominated by visual information based on sight and sound, but hardly at all on the combined senses of touch and sound. Visually impaired users, lacking sight are not often able to engage in cultural events. Compensated audio-description or talking books are standard products that visually impaired people can buy to imagine feature film stories or decide what is hap...
متن کاملA wearable haptic game controller
This paper outlines the development of a wearable game controller incorporating vibrotacticle haptic feedback that provides a low cost, versatile and intuitive interface for controlling digital games. The device differs from many traditional haptic feedback implementation in that it combines vibrotactile based haptic feedback with gesture based input, thus becoming a two way conduit between the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009